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ON  THE  LEAST  SQUARES  ESTIMATOR  IN  MOVING  AVERAGE  MODELS  OF  ORDER  ONE 
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University  of  Sheffield,  UK 


Keywords  :  Moving  average  model;  Least  squares  estimator;  Consistency 


Language 


Fortran  77 


Description  and  pui 


Given  a  time  series  data,  estimate  6  in  the  moving  average  model 


Yt  ■  +  Bet_^,  t  *  1,2,3,...  of  order  one  using  the  method  of  least  squares. 


Theory 


Let  Yt  *  e^  +  Be^  t  ■  1,2,3,...  be  a  moving  average  process  of 


order  one,  where  e^*  0  and  e^,  e^ ,  . . .  is  a  sequence  of  independent  identically 


distributed  random  variables  with  mean  zero  and  variance  o  .  There  are  several 


methods  of  estimation  are  available  in  the  literature  for  estimating  B  for  a 


given  time  series  data  y^,  ...  ,  y^.  McClave  (1974)  compared  the  performance 


of  some  five  estimators  of  6  for  moderate  sample  sizes  by  simulating  the  process 


Y  ,  t  *  1,2,..., 100.  All  these  methods  use  approximations  of  one  kind  or  the 


other  and  involve  selection  of  some  indices  for  a  good  degree  of  approximation. 


Consequently,  the  execution  of  these  methods  looks  complex  and  it  is  natural  co 


search  for  a  simple  method  which  performs  competitively  well  with  these  methods. 


The  method  of  least  square  is  intuitively  very  appealing,  and  recently,  under 


some  conditions,  Macpherson  and  Fuller  (1983)  showed  that  the  least  squares 


8 


5WW 


puwwswfwwvwv*  'JiVTW'jrm.v*  vrv  t  ir’jr^jr'  v»  vunur"jr*jr'ir-jr»jr  'jt  *>  v>vvv  vvv  vv  uw.v  vwwvwmvv.v.m'wyj 

£3 


-2- 


estimator  is  consistent  for  9  in  [-1,1].  We  have  compared  the  performance 
of  least  squares  estimator  for  moderate  sample  sizes  vis-a-vis  with  the  five 
estimators  examined  by  McClave  (1974) .  See  Niroomand  Chapeh  and  Bhaskara  Rao 
(1987).  The  least  squares  estimator  comes  out  better  than  these  five  estimators. 
Additionally,  as  the  present  article  demonstrates,  the  execution  of  the  least 
squares  method  is  much  simpler  than  these  five  methods. 


Following  Macpherson  and  Fuller  (1983)  ,  the  least  squares  estimator 
of  3  is  that  value  of  9  in  [-1,1]  that  minimizes 


V9) '  E"-i  tVT!»>i2- 


where  e  (Y:9)  -  Y  -  9e  ,(Y:9),  t  -  1,2,...,N  and  e  (Y:9)  -  0.  It  works  out 
C  C  t-i  o 


chac 


\«'9>  •  ?k  -  «k-l  +  °\-2  -  ■-  * 


k  -  1,2,...,N.  Consequently,  Q  (9)  is  a  polynomial  in  9  of  degree  2N-2. 


More  explicitly,  for  N  even. 
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The  above  expression  looks  formidable  to  include  in  a  computer  program 
However,  the  above  can  be  simplified  as  follows.  'Lee  A  be  the  matrix  of  order 
NxN  defined  by 


Y1 

0 

0 

0 

0 

0 

Y2 
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Let  9  be  the  column  vector  of  order  Nxl  defined  by 

T  23  N-l 

9  -  [1,  9,  9  ,  9  ,  ...  ,  9  i], 

where  T  stands  for  operation  transpose.  -It  can  be  verified  that 

0jj(9)  "  9T(ATA)0. 

We  use  this  simple  form  of  Q„( 9)  in  the  computer  program  to  estimate  3 


We  used  the  method  of  least  squares  to  fit  a  first  order  moving  average 
model  to  the  first  order  differences  of  the  time  series  data  "IBM  Common  Stock 
Closing  Prices  -  Daily,  17th  May,  1961  to  2nd  November,  1962".  See  Box  and  Jenkins 
(1976,  p.239  and  p.526).  The  fitted  model  works  out  to  be 

VYc  -  et  +  0.089e  , 

VY  ”  Y  -  Y  and  Y  's  are  the  original  series.  Box  and  Jenkins  obtained  the 

t  t  t”  X  X  f  * 

estimate  of  8  to  be  0.09. 

Structure 

SUBROUTINE  ZXMWD ( FCN ,M,NS1G , A1 ,B1 ,NSRCH ,X, F , WORK , IWORK , IER) 

Formal  parameters 

M  _ ,  Integer  Input:  number  of  unknowns  parameters 

NSIG  Integer  Input:  number  of  digits  of  accuracy  required  in  the  parameter 

estimates 

Al,  B1  Real  arrays  Constraint  vectors  of  length  of  M 

Input:  X(I)  is  required  to  satisfy  -  A1(I) .LE.X(I) .LE.Bl(I) 

NSRCH  Integer  Number  of  starting  points  to  be  generated 

Input:  suggested  value  «  min(2**M+5 ,100) 

X  Real  array  Vector  of  length  M  containing  the  final  parameter  estimates 

(output) 

F  Real  Value  of  the  function  at  the  final  parameter  estimates  (output) 

WORK  Real  array  Work  vector  of  length  M*(M4-1) /2+ll*M 

IWORK  Integer  array 

Work  vector  of  length  M 

IER  Real  Error  parameter  (output) 
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Terminal  error 

IER-129  indicates  that  the  algorithm  has  converged  to 
a  point  which  may  only  be  a  saddle  point 

IER=130  indicates  that  it  was  not  possible  to  calculate 
the  solution  to  NS1G  digits  (See  remarks) 

IER*>131  indicates  that  iteration  was  terminated  after 
200*(N+1)  function  evaluations  (See  remarks) 

IER=*132  indicates  that  AMD  .GE.Bl(I)  for  some  I  »  1,2,...,N. 
No  attempt  is  made  to  find  the  minimum  in  this  case. 

Remarks  When  IER  is  returned  as  130  or  131,  the  parameter  estimates 

in  X  may  not  be  reliable.  Futher  checking  should  be  performed. 
Use  of  a  larger  NSRCH  may  produce  more  reliable  parameter 
estimates.  ’ 

Auxiliary  algorithms 

SUBROUTINE  ZXMWD  will  use  the  FCN(M,X,F)  to  minimize  F 
M  Integer  Input:  number  of  unknown  parameters 

X  Real  array  Vector  of  length  M  containing  the  final  parameter  estimates 

(output) 

F  Real  Output:  Value  of  the  function  at  the  final  parameter  estimrt®^ 

SUBROUTINE  VMULFF(AMATT,AMAT ,L,KA,KB ,IA,IB ,C ,IC,IER)  will  find  the  multiplication 
of  two  matrices  AMATT  and  AMAT 

Formal  parameters 


AMATT 

Real  array 

Input : 

N  by  N 

matrix  stored  in 

full  storage 

mode 

AMAT 

Real  array 

Input : 

N  by  N 

matrix  stored  in 

full  storage 

mode 

L 

Integer 

Input : 

number 

of  rows  in  AMATT 

KA 

Integer 

Input : 

number 

of  columns  in  AMATT 

KB 

Integer 

Input : 

number 

of  columns  in  AMAT 

IA 

Integer 

Input : 

row  dimension  of  matrix 

AMATT 

IB 

Integer 

Input : 

row  dimension  of  matrix 

AMAT 

Real  array  Output:  N  by  N  matrix  containing  the  product  C  -  AMATT * AMAT 


Integer 


Input:  row  dimension  of  matrix  C 


Integer  Output:  Error  indicator 


IER»129  indicates  that  AMATT  or  AMAT  or  C  was  dimensioned 
incorrectly 


References 

» 

Box,  G.E.?.  and  Jenkins,  G.M.  (1976)  Time  Series  Analysis  :  Forecasting  and  Control. 
Holden-Day,  Oakland,  California 

Macpherson,  B.D.  and  Fuller,  W.A.  (1983)  -  Consistency  of  the  least  squares  estimator 
of  the  first  order  moving  average  parameter,  Ann.Stat.,  11,326-329. 

McClave,  J.T.  (1974)  -  A  comparison  of  moving  average  estimation  procedures, 

Comm. Start . ,  3,  865-883. 

Niroomand  Chapeh,  H.A.  and  Bhaskara  Rao ,  M.  (1987)  -  A  comparison  of  various 
methods  of  estimation  in  moving  average  models  (in  preparation). 


THIS  PROGRAM  -ILL  FIT  THE  FIRST  I  RLE?.  MOVING  AVERAGE  MCLEL 


INTEGER 


IER,N,L.KA,53,:A,:3,:C.N'S:G,NSRCH,:V0Ri:  :  ,M, 


X(I)  ,AL  ,31,-CRK  1:  : .f.amat  n-  ,n-  .AMATT  ‘>,N 


EXTERNAL  FCN 


COMMON 


f: -o.o 


F2-0.0 


OPEN (UNIT- 100,  FILE-' DATA. DAT’ .STATUS- ’ OLD’ 
OPEN (UNIT-99  ,  FILE-  '  RES  .DAT  ’  .  STATUS-  'NET-  1 ) 
READ (100,*)  IV 


NSIG-4 


NSRCH-7 


AI-1.0 


El-1.0 


THE  GIVEN  DATA  IS  PUT  INTO  THE  MATRIX  A  AS  EXPLAINED  IN 


J-l  ,N 


DO  2  I-J  ,N 


V.v  .v  .%  .V  .N 


SUM2=0.0 


DO  30  I=J+2-N,N 

SUM2=SUM2+C  (I ,  J+2-I) 
F2=F2+(X(1)**J)*SUM2 


F=*F1+F2 


RETURN 


Concluding  remarks  :  This  work  is  useful  for  drawing  inferences  for  signal  process 

models  when  the  observations  form  a  moving  average  model  of 
order  one.  A  manuscript  is  under  preparation  detailing 
applications  of  the  results  of  this  paper  to  signal  processing 
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A  simple  expression  is  derived  in  this  paper  for  the  error  sum  of  squares 
in  the  context  of  moving  average  models  of  order  one.  A  computer  program  is 
developed  to  estimate  the  parameter  of  a  moving  average  model  of  order  one 
based  on  the  method  of  least  squares. 
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